SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN, that I: Ben Hitt, a resident of Severn, Maryland, has invented certain 
new and useful improvements in HEURISTIC METHOD OF CLASSIFICATION, of which 
the following is a specification. 



Heuristic Method of Classification 

This application claims benefit under 35 U.S.C. sec. 1 19(e)(1) of the priority of application 
Serial No. 60/212,404, filed June 19, 2000, which is hereby incorporated by reference in its 
entirety. 

I. Field of the Invention 

The field of the invention concerns a method of analyzing and classifying objects which 
can be represented as character strings, such as documents, or strings or tables of numerical data, 
such as changes in stock market prices, the levels of expression of different genes in cells of a 
tissue detected by hybridization of mRNA to a gene chip, or the amounts of different proteins in 
a sample detected by mass spectroscopy. More specifically, the invention concerns a general 
method whereby a classification algorithm is generated and verified from a learning data set 
consisting of pre-classified examples of the class of objects that are to be classified. The pre- 
classified examples having been classified by reading in the case of documents, historical 
experience in the case of market data, or pathological examination in the case of biological data. 
The classification algorithm can then be used to classify previously unclassified examples. Such 
algorithms are generically termed data mining techniques. The more commonly applied data 
mining techniques, such as multivariate linear regression and non linear feed-forward neural 
networks have an intrinsic shortcoming, in that, once developed, they are static and cannot 
recognize novel events in a data stream. The end result is that novel events often get 
misclassified. The invention concerns a solution to this shortcoming through an adaptive 
mechanism that can recognize novel events in a data stream. 



II. Background of the Invention 

The invention uses genetic algorithms and self organizing adaptive pattern recognition 
algorithms. Genetic algorithms were described initially by Professor John H. Holland. (J.H. 
Holland, Adaptation in Natural and Artificial Systems \ MIT Press 1992, see also U.S. patent No. 
4,697,242 and No. 4,881,178). A use of a genetic algorithm for pattern recognition is described 
in U.S. patent No. 5,136,686 to Koza, see column 87. 

Self organizing pattern recognition has been described by Kohonen. (T. Kohonen, Self 
Organizing and Associative Memory, 8 Series in Information Sciences, Springer Verlag, 1984; 
Kohonen, T, Self organizing Maps, Springer Verlag, Heidelberg 1997 ). The use of self 
organizing maps in adaptive pattern recognition was described by Dr. Richard Lippman of the 
Massachusetts Institute of Technology . 

III. Summary of the Invention 

The invention consists of two related heuristic algorithms, a classifying algorithm and a 
learning algorithm, which are used to implement classifying methods and learning methods. The 
parameters of the classifying algorithm are determined by the application of the learning 
algorithm to a training or learning data set. The training data set is a data set in which each item 
has already been classified. Although the following method is described without reference to 
digital computers, it will be understood by those skilled in the art that the invention is intended 
for implementation as computer software. Any general purpose computer can be used; the 
calculations according to the method are not unduly extensive. While computers having parallel 
processing facility could be used for the invention, such processing capabilities are not necessary 
for the practical use of the learning algorithm of the invention. The classifying algorithm 
requires only a minimal amount of computation. 



The classifying method of the invention classifies Objects according to a data stream that 
is associated with the Object. Each Object in the invention is characterized by a data stream, 
which is a large number, at least about 100 data points, and can be 10,000 or more data points. 
A data stream is generated in a way that allows for the individual datum in data streams of 
different samples of the same type of Object to be correlated one with the other. 

Examples of Objects include texts, points in time in the context of predicting the 
direction of financial markets or the behavior of a complex processing facility, and biological 
samples for medical diagnosis. The associated data streams of these Objects are the distribution 
of trigrams in the text, the daily changes in price of publicly traded stocks or commodities, the 
instantaneous readings of a number of pressure, temperature and flow readings in the processing 
facility such as an oil refinery, and a mass spectrum of some subset of the proteins found in the 
sample, or the intensity mRNA hybridization to an array of different test polynucleotides. 

Thus, generically the invention can be used whenever it is desired to classify Objects into 
one of several categories, e.g., which typically is two or three categories, and the Objects are 
associated with extensive amounts of data, e.g., typically thousands of data points. The term 
"Objects" is capitalized herein to indicate that Objects has a special meaning herein in that it 
refers collectively to tangible objects, e.g., specific samples, and intangible objects, e.g., writings 
or texts, and totally abstract objects, e.g., the moment in time prior to an untoward event in a 
complex processing facility or the movement in the price of a foreign currency. 

The first step of the classifying method is to calculate an Object vector, i.e., an ordered 
set of a small number of data points or scalers (between 4 and 100, more typically between 5 and 
30) that is derived from the data stream associated with the Object to be classified. The 
transformation of the data steam into an Object vector is termed "abstraction." The most simple 



abstraction process is to select a number of points of the data stream. However, in principle the 
abstraction process can be performed on any function of the data stream. In the embodiments 
presented below abstraction is performed by selection of a small number of specific intensities 
from the data stream. 

5 In one embodiment, the second step of the classifying method is to determine in which 

data cluster, if any, the vector rests. Data clusters are mathematical constructs that are the 
multidimensional equivalents of non-overlapping "hyperspheres" of fixed size in the vector 
space. The location and associated classification or "status" of each data cluster is determined by 
the learning algorithm from the training data set. The extent or size of each data cluster and the 
ttO number of dimensions of the vector space is set as a matter of routine experimentation by the 

operator prior to the operation of the learning algorithm. If the vector lies within a known data 
u cluster, the Object is given the classification associated with that cluster. In the most simple 
i?| embodiments the number of dimensions of the vector space is equal to the number of data points 
O that is selected in the abstraction process. Alternatively, however, each scaler of the Object 

ill 

H : 5 vector can be calculated using multiple data points of the data stream. If the Object vector rests 
j*f outside of any known cluster, a classification can be made of atypia, or atypical sample. 

In an alternative embodiment, the definition of each data cluster as a hypersphere is 
discarded and the second step is performed by calculating the match parameter p = E (min (|Ii | , 
|Wj |) /s (|Wi |), where Ii are the scalers of the Object vector and Wi are the scalers of the centroid 
20 of the preformed classifying vector. The match parameter p is also termed a normalized "fuzzy" 
AND. The Object is then classified according to the classification of the preformed vector to 
which it is most similar by this metric. The match parameter is 1 when the Object vector and the 
preformed vector are identical and less than 1 in all other cases. 
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The learning algorithm determines both the details of abstraction process and the identity 
of the data clusters by utilizing a combination of known mathematical techniques and two pre-set 
parameters. A user pre-sets the number of dimensions of the vector space and the size of the 
data clusters or, alternatively, the minimum acceptable level of the "fuzzy AND" match 
5 parameter p. As used herein the term "data cluster" refers to both a hypersphere using a 
Euclidean metric and preformed classified vectors using a "fuzzy AND" metric. 

Typically the vector space in which the data clusters lie is a normalized vector space so 
that the variation of intensities in each dimension is constant. So expressed the size of the data 
cluster using a Euclidean metric can be expressed as minimum percent similarity among the 
^ Jo vectors resting within the cluster. 

■J In one embodiment the learning algorithm can be implemented by combining two 

K different types of publicly available generic software, which have been developed by others and 
m are well known in the field: (1) a genetic algorithm (J.H. Holland, Adaptation in Natural and 
Q Artificial Systems, MIT Press 1992) that processes a set of logical chromosomes 1 to identify an 
45 optimal logical chromosome that controls the abstraction of the data steam and (2) an adaptive 
fj self-organizing pattern recognition system (see, T. Kohonen, Self Organizing and Associative 
Memory, 8 Series in Information Sciences, Springer Verlag, 1984; Kohonen, T, Self-organizing 
Maps, Springer Verlag, Heidelberg 1997 ), available from Group One Software, Greenbelt, MD, 
which identifies a set of data clusters based on any set of vectors generated by a logical 
20 chromosome. Specifically the adaptive pattern recognition software maximizes the number of 

1 The term logical chromosome is used in connection with genetic learning algorithms 
because the logical operations of the algorithm are analogous to reproduction, selection, 
recombination and mutation. There is, of course, no biological embodiment of a logical 
chromosome in DNA or otherwise. The genetic learning algorithms of the invention are purely 
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vectors that rest in homogeneous data clusters, i.e., clusters that contain vectors of the learning 
set having only one classification type. 

To use a genetic algorithm each logical chromosome must be assigned a "fitness." The 
fitness of each logical chromosome is determined by the number of vectors in the training data 
5 set that rest in homogeneous clusters of the optimal set of data clusters for that chromosome. 
Thus, the learning algorithm of the invention combines a genetic algorithm to identify an optimal 
logical chromosome and an adaptive pattern recognition algorithm to generate an optimal set of 
data clusters and a the fitness calculation based on the number of sample vectors resting in 
homogeneous clusters. In its broadest embodiment, the learning algorithm of the invention 
WO consists of the combination of a genetic algorithm, a pattern recognition algorithm and the use of 
J J a fitness function that measures the homogeneity of the output of the pattern recognition 
H algorithm to control the genetic algorithm. 

m To avoid confusion, it should be noted that the number of data clusters is much greater 

O than the number of categories. The classifying algorithms of the examples below sorted Objects 
145 into two categories, e.g., documents into those of interest and those not of interest, or the clinical 

~ iris 

p samples into benign or malignant. These classifying algorithms, however, utilize multiple data 
clusters to perform the classification. When the Object is a point in time, the classifying 
algorithm may utilize more than two categories. For example, when the invention is used as a 
predictor of foreign exchange rates, a tripartite scheme corresponding to rising, falling and mixed 
20 outlooks would be appropriate. Again, such a tripartite classifying algorithm would be expected 
to have many more than three data clusters. 

computational devices, and should not be confused with schemes for biologically-based 
information processing. 
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IV. Detailed Description of the Invention 

In order to practice the invention the routine practitioner must develop a classifying 
algorithm by employing the learning algorithm. As with any heuristic method, some routine 
experimentation is required. To employ the learning algorithm, the routine practitioner uses a 
5 training data set and must experimentally optimize two parameters, the number of dimensions 
and the data cluster size. 

Although there is no absolute or inherent upper limit on the number of dimensions in the 
vector, the learning algorithm itself inherently limits the number of dimensions in each 
implementation. If the number of dimensions is too low or the size of the cluster is too large, the 
£|0 learning algorithm fails to generate any logical chromosomes that correctly classify all samples 
IS with an acceptable level of homogeneity. Conversely, the number of dimensions can be too 
jjT large. Under this circumstance, the learning algorithm generates many logical chromosomes that 
m have the maximum possible fitness early in the learning process and, accordingly, there is only 
□! abortive selection. Similarly, when the size of the data clusters is too small, the number of 
W : 5 clusters will be found to approach the number of samples in the training data set and, again, the 
^ routine practitioner will find that a large number of logical chromosomes will yield a set of 
completely homogeneous data clusters. 

Although the foregoing provide general guidance for the selection of the number of 
dimensions and the data cluster size for a classifying algorithm, it should be understood that the 
20 true test of the value of a classifying algorithm is its ability to correctly classify data streams that 
are independent of the data stream in the training data set. Therefore, the routine practitioner 
will understand that a portion of the learning data set must be reserved to verify that the 
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classification algorithm is functioning with an error rate, that is acceptable for the intended 
purpose. The particular components of the invention are described in greater detail below. 
A. The Data Stream and Types of Objects 

The classification of Objects and the generation of the associated data stream depend 
upon the nature of the problem to be addressed. The general principles are illustrated by the 
following examples. 

Documents: In one embodiment the invention provides a method for the computerized 
classification documents. For example, one may want to extract the documents of interest from a 
data base consisting of a number of documents too large to review individually. For these 
circumstances, the invention provides a computerized algorithm to identify a subset of the 
database most likely to contain the documents of interest. Each document is an Object, the data 
stream for each document consists of the histogram representing the frequency of each of the 
17576 (26 3 ) three letter combinations (trigrams) found in the document after removal of spaces 
and punctuation. Alternatively, a histogram of the 9261 trigrams of consonants can be prepared 
after the further removal of vowels from the document. The training data set consists of a 
sample of the appropriate documents that have been classified as "of interest" or "not of 
interest," according to the needs of the user. 

Financial Markets: It is self-evident that financial markets respond to external events 
and are interrelated to each other in a consistent fashion; for example, foreign exchange rates are 
influenced by the attractiveness of investment opportunities. However, the direction and extent 
of the response to an individual event can be difficult to predict. In one embodiment, the 
invention provides an algorithm computerized prediction of prices in one market based on the 
movement in prices in another. Each point in time is an Object, for example hourly intervals, the 
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data stream for hour consists of the histogram of the change in price of publicly traded securities 
in the major stock markets in the relevant countries, e.g., the New York and London stock 
exchanges where the exchange rate of the pound and dollar are of interest. The training data set 
consists of the historical record such price changes that has been classified as preceding a rise or 
5 fall in the dollar:pound rate. 

Processing Facilities: In a complex processing facility, such as an oil refinery, oil field or 
petrochemical plant, the pressure, temperature, flow and status of multiple valves and other 
controls (collectively the "status values") are constantly monitored and recorded. There is a need 
to detect impending untoward events before the untoward event becomes a catastrophic failure. 
IS) The present invention provides a computerized algorithm to classify each point in time as either 
;2 a high-risk or normal-risk time point. The data stream consists of the status values for each point 
^ in time. The training data set consists of the historical record of the status values classified as 
|?i either preceding an untoward event or as preceding normal operation, 
p Medical Diagnosis: The invention can be used in the analysis of a tissue sample for 

!#5 medical diagnosis, e.g., , for analysis of serum or plasma. The data stream can be any 
P reproducible physical analysis of the tissue sample that results in 2,000 or more measurements 
that can be quantified to at least 1 part per thousand (three significant figures). Time of flight 
mass spectra of proteins are particularly suitable for the practice of the invention. More 
specifically, matrix assisted laser desorption ionization time of flight (MALDI-TOF) and 
20 surface enhanced laser desorption ionization time of flight (SELDI-TOF) spectroscopy. See 
generally WO 00/49410. 

The data stream can also include measurements that are not inherently organized by a 
single ordered parameter such as molecular weight, but have an arbitrary order. Thus, DNA 
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microarray data that simultaneously measures the expression levels of 2,000 or more genes can 
be used as a data stream when the tissue sample is a biopsy specimen, recognizing that the order 
of the individual genes is the data stream is arbitrary. 

Specific diseases where the present invention is particularly valuable occur when early 
5 diagnosis is important, but technically difficult because of the absence of symptoms and the 
disease may be expected to produce differences that are detectable in the serum because of the 
metabolic activity of the pathological tissue. The early diagnosis of malignancies are a primary 
focus of the use of the invention. The working example illustrates the diagnosis of prostatic 
carcinoma, similar trials for the diagnosis of ovarian cancers have been performed. 
WO It should be noted that a single data stream from a patient sample can be analyzed for 

]*f multiple diagnoses using the method of the invention. The additional cost of such multiple 
!** analysis would be trivial because the steps specific to each diagnosis are computational only. 

m B. The Abstraction Process and Logical Chromosome 

3 

Q The first step in the classifying process of the invention is the transformation or 

11 i 

N : 5 abstraction of the data stream into a characteristic vector. The data may be conveniently 

iO 

p normalized prior to abstraction by assigning the overall peak a arbitrary value of 1 .0 and all other 

|4 

points given fractional values. The most simple abstraction of a data stream consists of the 
selection of a small number of data points. Those skilled in the will recognize that more 
complex functions of multiple points could be constructed such as averages over intervals or 
20 more complex sums or differences between data points that are at predetermined distance from a 
selected prototype data point. Such functions of the intensity values of the data stream could 
also be used and are expected to function equivalently to the simple abstract illustrated in the 
working examples. 
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The skilled will also appreciate that routine experimentation can determine whether 
abstraction by taking the instantaneous slope at arbitrary points could also function in the present 
invention. Accordingly, such routinely available variations of the illustrated working examples 
are within the scope of the invention. 

A feature of the invention is the use of a genetic algorithm to determine the data points 
which are used to calculate the characteristic vector. In keeping with the nomenclature of the art, 
the list of the specific points to be selected is termed a logical chromosome. The logical 
chromosomes contain as many "genes" as there are dimensions of the characteristic vector. Any 
set of the appropriate number of data points can be a logical chromosome, provided only that no 
gene of a chromosome is duplicated. The order of the genes has no significance to the invention. 

Those skilled in the art appreciate that a genetic algorithm can be used when two 
conditions are met. A particular solution to a problem must be able to be expressed by a set or 
string of fixed size of discrete elements, which elements can be numbers or characters, and the 
strings can be recombined to yield further solutions. One must also be able to calculate a 
numerical value of the relative merit of each solution, its fitness. Under these circumstances the 
details of the genetic algorithm are unrelated to the problem whose solution is sought. 
Accordingly, for the present invention, generic genetic algorithm software may be employed. 
The algorithms in PGAPack libraries, available from Argonne National Laboratory is suitable. 
The calculation of the fitness of any particular logical chromosome is discussed below. 

The first illustrative example concerns a corpus of 100 documents, which were randomly 
divided into a training set of 46 documents and a testing set of 54 documents. The documents 
consisted of State of the Union addresses, selections from the book The Art of War and articles 
from the Financial Times. The distribution of trigrams for each document was calculated. A 
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vector space of 25 dimensions and a data cluster size in each dimension of 0.35 times the range 
of values in that dimension was selected. The genetic algorithms were initialized with about 
1,500 randomly chosen logical chromosomes. As the algorithm progressed the more fit logical 
chromosomes are duplicated and the less fit are terminated. There is recombination between 
5 chromosomes and mutation, which occurs by the random replacement of an element of a 

chromosome. It is not an essential feature of the invention that the initially selected collection of 
logical chromosome be random. Certain prescreening of the total set of data streams to identify 
those data points having the highest variability may be useful, although such techniques may also 
introduce an unwanted initialization bias. Those skilled in the art appreciate that the initial set 
1300 of chromosomes, the mutation rate and other boundary conditions for the genetic algorithm are 
not critical to its function. 

i ; E 

I*f C. The Pattern Recognition Process and Fitness Score Generation 

S The fitness score of each of the logical chromosomes that are generated by the genetic 

q algorithm is calculated. The calculation of the fitness score requires an optimal set of data 
!#5 clusters be generated for each logical chromosome that is tested. Data clusters are simply the 
0 volumes in the vector space in which the Object vectors of the training data set rest. The method 
of generating the optimal set of data clusters is not critical to the invention and will be 
considered below. However, whatever method is used to generate the data cluster map, the map 
is constrained by the following rules: each data cluster should be located at the centroid of the 
20 data points that lie within the data cluster, no two data clusters may overlap and the dimension of 
each cluster in the normalized vector space is fixed prior to the generation of the map. 

The size of the data cluster is set by the user during the training process. Setting the size 
too large results in a failure find any chromosomes that can successfully classify the entire 
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training set, conversely setting the size to low results in a set of optimal data clusters in which 
the number of clusters approaches the number of data points in the training set. More 
importantly, a too small setting of the size of the data cluster results in "overfitting," which is 
discussed below. 

The method used to define the size of the data cluster is a part of the invention. The 
cluster size can be defined by the maximum of the equivalent of the Euclidean distance (root sum 
of the squares) between any two members of the data cluster. A data cluster size that 
corresponds to a requirement of 90% similarity is suitable for the invention when the data stream 
is generated by SELDI-TOF mass spectroscopy data. Somewhat large data clusters have been 
found useful for the classification of texts. Mathematically, 90% similarity is defined by 
requiring that the distance between any two members of a cluster is less than 0.1 of the 
maximum distance between two points in a normalized vector space. For this calculation, the 
vector space is normalized so that the range of each scalar of the vectors within the training data 
set is between 0.0 and L0. Thus normalized, the maximal possible distance between any two 
vectors in the vector space is then root N, where N is the number of dimensions. The Euclidean 
diameter of each cluster is then 0.1 x root(N). 

The specific normalization of the vector space is not a critical feature of the method. The 
foregoing method was selected for ease of calculation. Alternative normalization can be 
accomplished by scaling each dimension not to the range but so that each dimension has an equal 
variance. Non-Euclidean metrics, such as vector product metrics can be used. 

Those skilled in the art will further recognize that the data stream may be converted into 
logarithmic form if the distribution of values within the data stream is log normal and not 
normally distributed. 

14 



Once the optimal set of data clusters for a logical chromosome has been generated, the 
fitness score for that chromosome can be calculated. For the present invention, the fitness score 
of the chromosome roughly corresponds to the number of vectors of the training data set that rest 
in clusters that are homogeneous, i.e., clusters that contain the characteristic vectors from 
5 samples having a single classification. More precisely, the fitness score is calculated by 

assigning to each cluster a homogeneity score, which varies from 0.0 for homogeneous clusters 
to 0.5 for clusters that contain equal numbers of malignant and benign sample vectors. The 
fitness score of the chromosome is the average fitness score of the data clusters. Thus, a fitness 
score of 0.0 is the most fit. There is a bias towards logical chromosomes that generate more data 
1330 clusters, in that when two logical chromosomes that have equal numbers of errors in assigning 
W the data, the chromosome that generates the greater number of clusters will have a lower 

average homogeneity score and thus a better fitness score. 
m Publicly available software for generating using the self-organizing map is has been 

□ given several names, one is a "Lead Cluster Map" and can be implemented by generic software 
I#5 that is available as Model 1 from Group One Software (Greenbelt, MD), 
Q An alternative embodiment of the invention utilizes a non-Euclidean metric to establish 

the boundaries of the data clusters. A metric refers to a method of measuring distance in a vector 
space. The alternative metric for the invention can be based on a normalized "fuzzy AND" as 
defined above. Soft ware that implements an adaptive pattern recognition algorithm based on the 
20 "fuzzy AND" metric is available from Boston University under the name Fuzzy ARTMAP. 
D. Description and Verification of Specific Embodiments 

Those skilled in the art understand that the assignment of the entire training data set into 
homogeneous data clusters is not in itself evidence that the classifying algorithm is effectively 
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operating at an acceptable level of accuracy. Thus, the value of the classifying algorithm 
generated by a learning algorithm must be tested by its ability to sort a set of data other than the 
training data set. When a learning algorithm generates a classifying algorithm that successfully 
assigns the training data set but only poorly assigns the test data set, the training data is said to be 
5 overfitted by learning algorithm. Overfitting results when the number of dimensions is too large 
and/or the size of the data clusters is too small. 

Document Clustering: Document (text) clustering is of interest to a wide range of 
professions. These include the legal, medical and intelligence communities. Boolean based 
search and retrieval methods have proven inadequate when faced with the rigors of the current 
WO production volume of textual material. Furthermore, Boolean searches do not capture conceptual 
information. 

52 A suggested approach to the problem has been to somehow extract conceptual 

m information in a manner that is amenable to numeric analysis. One such method is the coding of 
B a document as a collection of trigrams and their frequency of occurrence recorded. A trigram is 
!#5 a collection of any three characters, such as AFV, KLF, OID, etc. There are therefore 26 3 
Q trigrams. White space and punctuation are not included. A document can then be represented as 
segmented into a specific set of trigrams starting from the beginning of the text streaming from 
that document. The resulting set of trigrams from that document and their frequencies are 
characteristic. If documents in a set have similar trigram sets and frequencies, it is likely that 
20 they concern the same topic. This is particularly true if only specific subset of trigrams are 

examined and counted. The question is, which set of trigrams are descriptive of any concept. A 
learning algorithm according to the invention can answer that question. 
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A corpus of 100 English language documents from the Financial Times, The Art of War 
and the collection of presidential State of the Union addresses was compiled. The corpus was 
randomly segmented into training and testing corpi. All documents were assigned a value of 
either 0 or 1, where 0 indicated undesirable and 1 indicated desirable. The learning algorithm 
searched through the trigram set and identified a set of trigrams that separated the two classes of 
documents. The resultant model was in 25 dimensions with the decision boundary set at 0.35 the 
maximal distance allowed in the space. The classifying algorithm utilizes only 25 of the possible 
17,576 trigrams. On testing the results in the table obtained. 





Actual Classification 0 


1 


Totals 


Assigned Classification 0 


22 


2 


24 


1 


6 


24 


30 


Totals 


28 


26 


54 



Table: A Confusion Matrix. Actual values are read vertically and the results of an algorithm 
according to the invention are read horizontally. 

The results show that algorithm correctly identified 24 of the 26 documents that were of 
interest and correctly screened out or rejected 22 of the 26 documents that were not of interest. 



Evaluation of Biological States: The above-described learning algorithm was employed 
to develop a classification for prostatic cancer using SELDI-TOF mass spectra (MS) of 55 
patient serum samples, 30 having biopsy diagnosed prostatic cancer and prostatic serum antigen 
(PSA) levels greater than 4.0 ng/ml and 25 normals having PSA levels below 1 ng/ml. The MS 
data was abstracted by selection of 7 molecular weight values. 
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A cluster map that assigned each vector in the training data set to a homogeneous data 
cluster was generated. The cluster map contained 34 clusters, 17 benign and 17 malignant. 
Table 1 shows the location of each of data cluster of the map and the number of samples of the 
training set assigned to each cluster. 
5 The classifying algorithm was tested using 23 1 samples that were excluded from the 

training data set. Six sets of samples from patients with various clinical and pathological 
diagnoses were used. The clinical and pathological description and the algorithm results were as 
follows: 1) 24 patients with PSA >4 ng/ml and biopsy proven cancer, 22 map to diseased data 
clusters, 2 map to no cluster; 2) 6 normal, all map to healthy clusters; 3) 39 with benign 
j JO prostatic hypertrophy (BPH) or prostatitis and PSA < 4 ng/ml, 7 map to diseased data clusters, 
fi none to healthy data clusters and 32 to no data cluster; 4) 139 with BPH or prostatitis and PSA 
p >4 and <10 ng/ml, 42 map to diseased data clusters, 2 to healthy data clusters and 95 to no data 

*ss3s 

3 - 

^ cluster; 5) 19 with BPH or prostatitis and PSA > 10 ng/ml, 9 map to diseased data clusters none 

g to healthy and 1 0 to no data cluster. A sixth set of data was developed by taking pre- and post- 
pi 

jiS prostatectomy samples from patients having biopsy proven carcinoma and PSA > 10 ng/ml. As 
E expected each of the 7 pre-surgical samples was assigned to a diseased data set. However, none 

of the sample taken 6 weeks post surgery, at a time when the PSA levels had fallen to below 1 

ng/ml were not assignable to any data set. 

When evaluating the results of the foregoing test, it should be recalled that the rate of 
20 occult carcinoma in patients having PSA of 4-10 ng/ml and benign biopsy diagnosis is about 

30%. Thus, the finding that between 1 8% and 47% of the patients with elevated PSA, but no 

tissue diagnosis of cancer, is consistent with that correctly predicts the presence of carcinoma. 
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